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Abstract 

Shannon information entropy is a natural measure of probability (de)localization and thus 
(un)predictability in various procedures of data analysis for model systems. We pay particular 
attention to links between the Shannon entropy and the related Fisher information notion, which 
jointly account for the shape and extension of continuous probability distributions. Classical, 
dynamical and random systems in general give rise to time-dependent probability densities and 
associated information measures. The induced dynamics of Shannon and Fisher functionals reveals 
an interplay among various characteristics of the considered diffusion-type systems: information, 
uncertainty and localization while put against mean energy and its balance. 

1 Introduction 

We shall investigate relationships between the dynamical features of the differential entropy (Shannon 
entropy of general time-dependent continuous probability densities) , ^ El ' ano - so-called hydrody- 
namical conservation laws (mass/probability, momentum and energy balance in the mean) of the 
corresponding (ir)reversible diffusion-type process. 

In part, our arguments derive from a standard trajectory interpretation in which random transport 
is modelled in terms of a Markovian process and its sample paths. The pertinent process obviously 
complies with the Fokker-Planck dynamics of an initially prescribed probability density, 0] . 

However, we would like to point out that a generic property of physically interesting cases is 
their conflict with rather stringent growth and Holder continuity restrictions for drift and diffusion 
coefficient functions. Those bounds need to be respected for a mathematically consistent definition of 
the process and its transition density functions. In most of "typical" cases, the uniqueness and non- 
explosiveness of the process cannot be guaranteed, see however jSJ E] how to evade the explosiveness 
problem. 

This formal defect of a theoretical framework is usually bypassed in a pragmatic computer-assisted 
research by neglecting the unwanted (even if annoying, interpreted as artifacts) contributions to the 
data. In view of low probability for troublesome events (explosive behavior), it is often taken for 
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granted that a mathematical pedantry is here unnecessary and that the Langevin equation can be 
employed in the study of diffusion- type processes without any specific precautions. This attitude is 
omnipresent, when one attempts to solve explicitly the "obvious" Fokker-Planck or Smoluchowski 
diffusion equation, but does not inquire into an issue of transition probability density functions. 
Needless to say, with the latter step ignored, the random variable and random path notions are often 
maintained as legitimate elements of the analysis. 

On the other hand, the previously mentioned restrictions on drift and diffusion coefficient functions 
may be relaxed in a controlled way to allow for a consistent theory. There is an obvious price to be 
paid, one should admit and learn to live with non-unique and possibly explosive stochastic processes, 
all of them being capable to drive accordingly a unique probability density. Examples of such milder 
(than usual) restrictions can be found in Refs. [U0E1- 

The previous obstacles motivate a principal peculiarity of our approach which is rooted in the fact 
that we extract relevant data exclusively from the (basically, spatial) probability density of the perti- 
nent dynamical process and this density gradient, with no explicit mention of random or deterministic 
paths. Clearly, there are many distinct stochastic processes which can be associated with the once 
prescribed Fokker-Planck dynamics of a concrete probability density. 

It is widely accepted in the literature to invoke relative Kullback-Leibler entropies as "distance 
measures" in the set of different probability densities. In particular, for comparison of different 
solutions of a given Fokker-Planck equation, 13] . O ne often takes for granted that the Kullback 
entropy is a proper analog of Boltzmann's H-function in the diffusion process setting. The reason is 
that it never takes negative values, while the differential entropy does. Its time rate is negative, hence 
refers to a continually decreasing function in accordance with thermodynamical intuitions, which is 
not necessarily the case for Shannon entropies, P^. 

There is one minor obstacle: a closer inspection shows that the Kullback entropy is mainly explored 
under standard severe restrictions upon drift and diffusion coefficients. See e.g. for a verbal 
statement: "we assume that the drift coefficients have no singularities and that they do not allow the 
solutions to run away to infinity" . Not surprisingly, in a statistical physics lore, a tacit assumption 
is that " all solutions of the Fokker-Planck equation finally agree if we wait long enough" . Hence 
it is believed to be immaterial to discuss their behavior in other regimes, than close-to-equilibrium 
(asymptotic invariant density). 

Another peculiarity of our approach is that we are not quite interested in " measuring a distance" 
between two different probability densities. We rather wish to make a comparison of the very same 
non-equilibrium density and its differential entropy at different stages of their time evolution. In 
particular, the difference of the respective entropy values at two time instants is a legitimate "distance 
measure" (information gain or loss), p^, the time rate of information entropy is also a well defined 
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quantity. For those reasons, we deliberately avoid the use of the Kullback entropy and insist on 
investigating the role and potential utility of the Shannon-type information entropy per se. 

Other motivations come from varied attempts to use information theory concepts as natural tools 
for quantifying signatures of disorder and its intrinsic dynamics (time rate of generation/propagation of 
disorder, information flow, entropy production rate). This involves an issue of non-equilibrium steady 
states and the time rate ("speed") of an asymptotic approach to equilibrium, when time-reversible 
stationary processes ultimately enter the game, [5] ■ Discussions ^2 Q2I Q3| °f a physical role of the 
probability density gradient in classical non-equilibrium thermodynamics of irreversible processes are 
worth mentioning, to place our discussion in a proper context. 

An analysis of links |16l 117) between dynamical systems, weak noise and information entropy pro- 
duction is also useful to that end. An independent input comes from general studies of the dynamical 
origin of increasing entropy ("dynamical foundations of the evolution of entropy to maximal states"), 
entirely carried out with respect to time-dependent probability densities, |3*l ll7llT%] see also |SJ^. 

The intertwined dynamics of the differential (information) entropy and t he probability localization 
properties (dynamics of uncertainty) appears to be an intrinsic physical feature of any formalism 
operating with general time-dependent (in the present paper, spatial) probability distributions. 

2 Information entropy and its dynamics 

Let us consider a classical dynamical system in R n whose evolution is governed by equations of motion: 

x = f{x) (1) 

where x stands for the time derivative and / is an i? n -valued function of x G R n , x = {x\, X2, x n }. 
The statistical ensemble of solutions of such dynamical equations can be described by a time-dependent 
probability density p{x,t) whose dynamics is given by the generalized Liouville (in fact, continuity) 
equation 

d tP ^-v- {fp) (2) 

where V = {d/dxx, d/dx n }. 

With any continuous probability density p = p(x,t), where x € R n and we allow for an explicit 
time-dependence, we can associate a probability density functional named Shannon entropy of a 
continuous probability distribution (convergence of an integral is presumed), pQ: 

S(p) — — J plnpdx. (3) 

In general, S(p) = S(t) depends on time. Let us take for granted that an interchange of time 
derivative with an indefinite integral is allowed (suitable precautions are necessary with respect to the 
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convergence of integrals). Then, we readily get an identity, [T4l IT5Hro| : 

S= f p(divf)dx = (V ■ /). (4) 



Accordingly, the information entropy S(t) grows with time only if the dynamical system has positive 
mean flow divergence. 

However, in general S is not positive definite. For example, dissipative dynamical systems are 
characterized by the negative (mean) flow divergence. Fairly often, the divergence of the flow is 
constant, |14j . Then, an "amount of information" carried by a corresponding statistical ensemble (e.g. 
its density) increases, which is paralleled by the information entropy decay (decrease). 

An example of a system with a point attractor (sink) at origin is a one-dimensional non-Hamiltonian 
system x = —x. In this case divf = — I and S = — I. A discussion of dynamical systems with 
strange (multifractal) attractors, for which the Shannon information entropy decreases indefinitely 
(the pertinent steady states are no longer represented by probability density functions) can be found 
in HUES. 

We note that for Hamiltonian systems, the phase-space flow is divergenceless, hence S = which 
implies that "information is conserved" in Hamiltonian dynamics. Take for example a two-dimensional 
conservative system with x = p/m and p = (— VV), where H = p 2 /2m + V(x). The classical equations 
of motion yield the standard Liouvillc equation (which is a special case of Eq. (@J): 

y=- L h + ^h (5) 

at m ox op 
for the phase-space density p(x,p). The corresponding divergence vanishes and the phase space 
volume is conserved. For non-Hamiltonian systems we may generically expect the phase-space volume 
contraction, expansion or both at different stages of time evolution, [141116) . 

In case of a general dissipative dynamical system a controlled admixture of noise can stabilize 
dynamics and yield asymptotic invariant densities. For example, an additive modification of the right- 
hand-side of Eq. JIJ by white noise term A{t) where (Ai(s)) = and (Aj (s)Aj(s')) = 2q5(s — s')5ij, 
i = 1,2, ...n, implies the Fokker-Planck-Kramers equation: 

d tP =-V-(fp)+qAp (6) 

where A = V 2 = d 2 /dxf. Accordingly, the differential entropy dynamics would take another form 
than this defined by Eq. (0J: 

S = j ' p (div f)dx + q J - (Vp) 2 dx. (7) 

Now, the dissipative term (V ■ /) < can be counterbalanced by a strictly positive stabilizing con- 
tribution q^2 i j ^(dp/dxi) 2 dx. This allows to expect that, under suitable circumstances dissipative 
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systems with noise may yield 5 = 0. In case of (V • /) > 0, the information entropy would grow 
monotonically. 

At this point, we depart from an explicit phase-space background for further discussion and con- 
sider exclusively spatial Markov diffusion processes with a diffusion coefficient D (constant or time- 
dependent, with standard dimensions of kgT/m(3 where (3 is a friction coefficient, or h/2m). We 
admit them to drive space-time inhomogeneous probability densities p — p(~o? , i) with a? £ i? 3 . The 
density gradient is introduced in conjunction with so-called osmotic velocity field it = In p, c.f. 
|18| . The probability density is to obey the continuity equation, with if set in correspondence with 
the previous vector- valued function / e R n : 

d t p = -V-(lfp) (8) 

where a (postulated) decomposition: lt(lf,t) = if = b — it allows us to infer the related Fokker- 
Planck equation: 

d t p = DAp - ^ ■ (tip) (9) 

with a forward drift function b (~af , t). 

To make things simpler, we assume to have given a concrete functional expression for the time- 
independent forward drift b (if) (here, we do not bother about its detailed justification on phenomeno- 
logical or model construction grounds) and fix initial/boundary data for the probability density p. We 
shall not demand the validity of standard mathematical restrictions (growth and Holder continuity 
conditions), guaranteeing the existence of non-explosive solutions X{t) of the underlying stochastic 
differential equation, since that would exclude a vast number of physically interesting situations, when 
the corresponding partial differential (Fokker-Planck) equation nonetheless has well defined solutions 
of the initial/boundary value problem. Therefore we prefer to investigate random diffusive motion 
in terms of probability densities, and not directly in terms of paths (sample trajectories) induced by 
random variable X*(t). 

With a solution p(lf,t) of the Fokker-Planck equation, we associate its differential (Shannon 
information) entropy S(t) = —fpliipd 3 x which typically is not time- independent, 114 ) . The 
evolution (dynamics of information) and rate of change in time of the entropy S directly follow. 

First, let us notice that in the particular case of if = —it (i.e. b — 0), where it = DX^lnp, we 
infer the standard free Brownian motion outcome, 11 : 

f=D.[^ X >0 (10) 
dt J p y ' 

to be compared with the previously introduced stabilizing term in Eq. JJJ). Thus, information entropy 
definitely increases in the Brownian motion and its time rate may be interpreted as the rate of 
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information decay (uncertainty increase) in the course of the diffusion process, in close parallel with 
the casual perception of the laws of thermodynamics. 

While passing from the free Brownian motion to the forced one and more general diffusion-type 
processes, we shall demand the current velocity l?(~5f,i) to be a gradient field it = b — it, where 
the forward drift b (it, t) of the process may be time-dependent. 

Boundary restrictions upon p, if p and b p to vanish at spatial infinities (or at finite spatial volume 
boundaries) yield the information entropy balance equation: 



~dt 



Jlp(V-T)+D-^^]d 3 x (11) 
to be compared with the previous, vanishing !) , case. We can rewrite this equation as follows: 

DS = (it 2 ) + ■ ~t) = D(V ■ if) (12) 

or equivalently 

DS= (It 2 ) - (t-lf) = -(It -It). (13) 
Note that we have employed an identity 

(It 2 ) = -D(V ■ It) . (14) 

The osmotic velocity field, by its very definition, always has negative mean divergence. 

The mean divergence of the current velocity field has no definite sign. Therefore the monotonic 
increase of S(t) is guaranteed only if - it) > 0, or equivalently ■ IT) > ■ it). Invariant 
probability densities are allowed when the information entropy remains constant in time: = 0, 
that is when ■ if ) = 0, i. c. (\? • ~t) = (\? • it). 

The simplest realization of the state of equilibrium is granted by 1) = it = In p, when the 
diffusion current identically vanishes: if = 7?. For familiar Smoluchowski diffusion processes whose 
drifts have the form 1) = —(l/m/3)^V, where V is time-independent, we immediately arrive at the 
classic equilibrium identity 

-{l/k B T)\?V = X?\np (15) 

with the implicit Einstein fluctuation-dissipation formula D — ksT ' /mf3 (ks is the Boltzmann con- 
stant). 

It is not obvious at all that the differential (Shannon information) entropy needs to increase, 
when a given "attracting" state of equilibrium (invariant density) is being asymptotically approached. 
Entropy decay scenario seems to be equally likely in this situation. 

A hint to this end: invoking the standard Smoluchowski diffusion, fix b (~af), i. e. external 
force, and fine-tune an initial density po(~^) so that (\? ■ !)) < (X? ■ it) and therefore - it) < 0. 
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Realization: consider the one-dimensional example with b(x) = —72:, 7 > and choose po(x) = 
[l/(crv / 27r] exp[— x 2 /2a 2 ], implying (V • u) = —D/o 2 . Finally adjust a and/or 7 to yield D/a 2 < 7. 

Let us also observe that, in view of DS = —{it ■ 1//), by reintroducing the diffusion current plT* 
and recalling that ~Tt — (DV p) / p : we arrive at: 

D ^ = -J IP- 1/2 (P^)] ■ [p- 1/2 (DVp)}d"x. (16) 

By means of the Schwarz inequality we infer an upper bound on the magnitude of the information 
entropy time rate: 

r^dS /_>2\ 1 /2 /_ > 2\ 1 /2 , , 

D\ — \ <{v ) (u ) . (17) 

As a byproduct we realize that a necessary condition for ^ 7^ is that both (T^ 2 ) and (it 2 ) are 
nonvanishing. A sufficient condition for ^ = is that any of (^ 2 ), (^ 2 )j or both vanish. 

3 Information entropy balance in Smoluchowski diffusion pro- 
cess 

Remembering that in the standard Brownian motion, essentially the same mathematical formalism ap- 
plies to a single particle and to a statistical ensemble of identical noninteracting Brownian particles, we 
shall adopt to our purposes basic tenets of so-called thermodynamic formalism of isothermal diffusion 
processes, [51[7|E1 ( see a ls° OH an d EU); originally introduced in connection with nonequilibrium 
thermodynamics of single macromolecules immersed in an ambient fluid at a constant temperature, 
and promoted in [5] to the status of "stochastic macromolccular mechanics". 

Let us discuss in more detail Eq. Ijl3|l for the differential entropy balance which is extremely 
persuasive in the special case of Smoluchowski diffusions. Indeed, then b = F /(m[3) stands for an 
externally acting force, capable of performing a mechanical work which in turn may be converted into 
heat. We refer to the standard phase-space conceptual background, |51l21|. 

According to [7| El ( we adjust their framework and notation to our purposes), close to equi- 
librium, one expects the information entropy to decrease in the course of the Smoluchowski diffusion 
process. The mean rate of the entropy loss per unit of mass, equals: 

f4/^-^4<^>- < 18 > 

That can be rewritten otherwise: ksTQ = J ~F ■ ~fd 3 x, where T is the temperature of the bath. 
In the formal thermodynamical lore, we deal here with the time rate at which the mechanical work 
is being dissipated into thermal environment in the form of (removed) heat. Let us point out that 
this interpretation is surely true under equilibrium conditions |o]- In general, far from equilibrium, 
the sign of dQ/dt remains indefinite and may refer to heat absorption (if negative) instead of heat 
removal. 
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The nonnegative term in Eq. i|13fl can be consistently interpreted, c.f. [5], as the measure of the 
entropy gain per unit of time by the diffusion process. Accordingly, we have: 



dS _ dSg a i n dQ, 



(19) 



dt dt dt 

where dS ga in/dt = (^ 2 )- If the entropy gain is counterbalanced by heat removal, we may have 

dS/dt = 0. 

Let us mention that our "entropy gain" is named "entropy production" in Ref. [5]. In the earlier 
literature on the subject, |3U|. the entropy production name has been reserved to the accumulating 
entropy surplus which is being removed from the system under consideration to the environment. In 
our discussion, just to the contrary, the information entropy appears to be pumped into the system 
(e.g. the diffusion process) instead of being removed. 

The relationship: 

~3=pD~f th (20) 
defines a thermodynamic force F th associated with the Smoluchowski diffusion: 

k B TF* th = T? - k B T^ In p = -^^>. (21) 

Notice that 

If = -(l/m/3)^*. (22) 

In the absence of external force (free Brownian motion), we obviously get D~P t h = —^t, Q = and 
S = Sg a i n , hence derealization coincides with the " diffusion of probability" . 
The mean value of the potential 

* = V + k B T\np (23) 
of the thermodynamic force defines the obvious diffusion process analogue of the Helmholtz free energy: 

(V) = (V)-TS G (24) 

where the dimensional version of information entropy Sg = k B S has been introduced (actually, it is 
a direct analog of the Gibbs entropy). The expectation value of the mechanical force potential (V) 
plays here the role of the mean internal energy. 

By assuming that pVlf vanishes at integration volume boundaries (or infinity), we easily get the 
time rate of Helmholtz free energy: 

±(*) = -k B TQ-TS G (25) 
dt 

where k B TQ = fl? ■ ~fd 3 x and TS G = J (k B TT ' th - ~P) ■ ~fd z x. In view of Eq. (JTSJl we get 

|<*) = -(m/3)<lf 2 ) (26) 
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which is either negative or vanishes. Therefore, the Helmholtz free energy either remains constant in 
time or decreases as a function of time. 

In the presence of external forces this property quantifies a possible asymptotic approach towards 
a minimum corresponding to an invariant density of the process. Indeed, a particular example of 
an equilibrium (invariant) density reads p(x) — (1/Z) exp^—V/kgT), where Z = J exp(— V/ksT) dx. 
Such p sets the pertinent minimum of (iff) at (\&) = "ff = — fc^TlnZ. This corresponds to W = 
V + ksT In p = const and thus trivially implies V \t = T? = if. 

One should be aware that an invariant density as well may not exist: in case of free Brownian 
motion there is no invariant density. 

4 Localization toolbox: Shannon entropy and Fisher informa- 
tion 

For simplicity all of our further discussion will be restricted to one space dimension. 

Let us consider the Gaussian probability density on the real line R as a reference density function: 
p{x) = [l/(<r\/27r] exp[— (x — xo) 2 /2a 2 ]. Among all one-dimensional distribution functions p(x) with a 
finite mean, subject to the constraint that the standard deviation is fixed at <r, it is the Gauss function 
with half- width a which sets a maximum of the differential entropy, . For the record, let us add that 
if only the mean is given for probability density functions on i?, then there is no maximum entropy 
distribution in their set. 

The differential entropy of the Gauss density has a simple analytic form, independent of the mean 
value xq and maximizes an inequality: 

S{p) < iln(27recr 2 ). (27) 

This imposes a useful bound upon the so-called entropy power, £Q: 

-±=exp[S(p)] <° (28) 
yzire 

with an obvious bearing on the spatial localization of the density p, hence spatial (un)certainty of 
position measurements. We can say that almost surely, with probability 0.998, the probability is 
concentrated within the interval of the length 6a which is centered about the mean value xq of the 
Gaussian density p. 

The Shannon entropy of an arbitrary continuous probability density is unbounded form below and 
from above, but in the subset of all densities with a finite mean and a fixed variance a 2 , we actually 
have an upper bound set by Eq. I|27|l. Note that not only for small, but also for relatively large mean 
deviation values a < l/^/2ne ~ 0.26 the differential entropy S(p) becomes negative. 
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Let us discuss to what extent, the Shannon entropy can be viewed as a measure of localization in 
the configuration space of the dynamical system. 

Let us consider a one-parameter family of probability densities p a {x) on R whose first (mean) 
and second moments (effectively, the variance) are finite. The parameter-dependence is here not 
completely arbitrary and we assume standard regularity properties that allow to differentiate various 
functions of p a with respect to the parameter a under the sign of an (improper) integral. 

Namely, let us denote J xp a (x)dx — f(a) and J x 2 p a dx < oo. We demand that as a function of 
x £ R, the modulus of the partial derivative dp a /da is bounded by a function G(x) which together 
with xG{x) is integrable on R. This implies, the existence of df /da and an important inequality: 

v«>WW** a (^)" (29) 



directly resulting from 



df 



[{x-a)p]/\^BApT]d X (30) 



da J a da 

via the standard Schwarz inequality, |22| . The equality appears if p a (x) is the Gauss function with 
mean value a. 

At this point let assume that the mean value of p a actually equals a and we fix at a 2 the value 
((x — a) 2 ) = (x 2 ) — a 2 of the variance (in fact, standard deviation from the mean value) of the 
probability density p a . The previous inequality now takes the familiar form: 

F a ±l±( d -f) 2 d*>\ (31) 
J p a \ da / er z 

where an integral on the left-hand-side is the so-called Fisher information of p a , known to appear in 
various problems of statistical estimation theory, as well as an ingredient of a number of information- 
theoretic inequalities. In view of T a > 1/cr 2 , we realize that the Fisher information is more sensitive 
indicator of the probability density localization than the entropy power, Eq. I|28|l . 

Let us define p a {x) = p(x — a). Then, the Fisher information can be readily transformed to the 
conspicuously quantum mechanical form (up to a factor D 2 with D = h/2m): 

l-(^) dx = [p-£dx = -(Q) (32) 



^dx , 

where u = Vlnp (up to a factor D) represents an osmotic velocity field, |181 124j. and an average 
(Q) = J p ■ Qdx is carried out with respect to the function 

An 1 / 2 

Q = 2-^ . (33) 
As a consequence of Eq. I)31|l. we have — (Q) > 1 /2a 2 for all relevant probability densities with variance 

„2 
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An important inequality, valid under an assumption p a (x) — p(x — a), has been proved in 31: 

1 



„ < (27re) exp[-2S(p)] < T a (34) 



It tells us that the lower bound for the Fisher information is in fact given a sharper form by means of 
the (squared) inverse entropy power. Our two information measures appear to be correlated. 

Under an additional decomposition/factorization ansatz (of the quantum mechanical L 2 (R n ) prove- 
nance) that p(x) = |?A| 2 (x), where a real or complex function ip = v /pexp(i0) is a normalized element 
of L 2 {R), another important inequality holds true, |31j : 

Ta = 4 j 2 dx < 167r 2 a 2 , (35) 

provided the Fisher information takes finite values. Here, a 2 is the variance of the "quantum me- 
chanical momentum canonically conjugate to the position observable" , up to (skipped) dimensional 
factors. In the above, we have exploited the Fourier transform ip = {Til!) of tp to arrive at p = \ip\ 2 
whose variance the above a 2 actually is. 

Let us point out that the Fisher information T{p) may blow up to infinity under a number of 
circumstances: when p approaches the Dirac delta behavior, if p vanishes over some interval in R or 
is discontinuous. We observe that T > because it may vanish only when p is constant everywhere 
on R, hence when p is not a probability density on R. 

In view of two previous inequalities, we find out that not only the Fisher information, but also an 
entropy power may be bounded from below and above. Namely, we have: 

-4 < F a < 16tt 2 ct 2 (36) 

which implies l/2cr 2 < — (Q) < %-k 2 <t 2 and furthermore 

< -4= exp[5(p)] <a. (37) 
47Tcr V27re 

Most important outcome of Eq. (|37|l is that the differential entropy S(p) typically may be expected 
to be a well behaved quantity: with finite lower and upper bounds. A standard statement in this 
regard is: Shannon entropy of a continuous probability density is neither bounded form below nor 
from above, 012- 

5 Dynamics of uncertainty: mean energy versus localization 

When multiplied by D 2 , a potential-type function Q — Q(x,t), c.f. Eq. (|33|l notoriously appears 
in the hydrodynamical formalism of quantum mechanics as the so-called de Broglie-Bohm quantum 
potential (D = h/2m), |2HI2B) . It appears as well in the corresponding formalism for diffusion-type 
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processes, including the standard Brownian motion (then, D = ksT/mfi, see e.g. [231 l2~4l 1251 1271 129] . 

We have: 

Q = 2D 2 ^ Tr = -u 2 +DV-u (38) 

and it is instructive to notice that the gradient of Q trivially appears (i.e. merely as a consequence of 
the heat equation, |231 124ll2l)| ) in the hydrodynamical (momentum) conservation law appropriate for 
the free Brownian motion: 

d t v + (y ■ V)v = -VQ . (39) 

We assume, modulo restrictions upon drift functions [fOE], that the Smoluchowski dynamics can 
be resolved in terms of (possibly non-unique) Markovian diffusion-type processes. Then, the following 
compatibility equations follow in the form of local (hydrodynamical) conservation laws for the diffusion 
process, 

d tP + W(vp) = (40) 
{d t +v-V)v = V(n-Q) (41) 

where, not to confuse this notion with the previous force field potential V, we denote by f2(x) the 
so-called volume potential for the process: 

1 / F \ 2 ( F 



Q = - + DV ■ . (42) 

Obviously the free Brownian law, Eq. I|39|) . comes out as the special case. 
In the above (we use a short-hand notation v = v(x,t)): 

v = b-u= — ; --D— (43) 
mp p 

defines the current velocity of Brownian particles in external force field. This formula allows us to 
transform the continuity equation into the Fokker-Planck equation and back. 

By considering (— p)(x, t) and s(x,t), such that v = Vs, as canonically conjugate fields, we can in- 
voke the variational calculus, |27II28| . Namely, one may derive the continuity (and thus Fokker-Planck) 
equation together with the Hamilton- Jacobi type equation (whose gradient implies the hydrodynam- 
ical conservation law Eq. H41J0 : 

3 t s + i(Vs) 2 -(f!-Q) = 0, (44) 

by means of the extremal (least, with fixed end-point variations) action principle involving the (mean) 
Lagrangian: 



P 



dts + ^(Vs) 2 - I y + -- 



dx . (45) 



12 



The related Hamiltonian (which is the mean energy of the diffusion process per unit of mass) reads 



H 



,2 



i(v.)*-(S- + n 



dx (46) 



v*J_-/'(?)*-/'(? +n| "^"- 



i. e. 

H=(l/2)((v 2 )-(u 2 ))-(n) . 

We can evaluate an expectation value of Eq. (|44|l which implies an identity H = — (dts). By 
invoking the Smoluchowski diffusion and thus Eq. (|24() . with the time- independent V , we arrive at 

* = M^ V (i;p) (47) 
P 

whose expectation value (^S), in view of — at the integration volume boundaries, identically 
vanishes. Since v = —(l/m/3)W^>, we define 

s(x,t) = (l/m/9)*(x,t) => (9 t s) = (48) 

so that Ti = identically. 

We have thus arrived at the following interplay between the mean energy, localization and the 
information entropy gain: 

D (dS\ 

gain 

generally valid for Smoluchowski processes with non-vanishing diffusion currents. 

By recalling the notion of the Fisher information Eq. \Y'>'ll and setting T = D 2 T a , we can rewrite 
the above formula as follows: 

T = (v 2 ) - 2(0) > (50) 

where J-/2 — —(Q) > holds true for probability densities with finite mean and variance. 

We may evaluate directly the localization/uncertainty dynamics of the Smoluchowski process, by 
recalling that the Fisher information T '/2 is the localization measure, which for probability densities 
with finite mean value and variance a 2 is bounded from below by l/cr 2 . 

Namely, by exploiting the hydrodynamical conservation laws Eq. I|41l) for the Smoluchowski process 
we get: 

d t (pv 2 ) - -V • [(pv 3 )} - 2pv ■ V(Q - 0) . (51) 

We assume to have secured conditions allowing to take a derivative under an indefinite integral, 
and assume that of pv 3 vanishes at the integration volume boundaries. This implies the following 
expression for the time derivative of (w 2 ): 

j t (v 2 ) = 2(v-V(n-Q)) . (52) 



13 



Proceeding in the same vein, in view of Q = 0, we find that 

d 



dt (n) = (vvn) (53) 

and so the equation of motion for T follows: 

j t ?=j t [{v 2 )-2{n)] = -2{v-VQ). (54) 

Since we have VQ = VP/p where P = D 2 pA\np, the previous equation takes the form T = 
— J pvS7Qdx = — J vV Pdx, which is an analog of the familiar expression for the power release 
(dE/dt = F ■ v, with F — — W) in classical mechanics. 

This should be compared with our previous discussion of the "heat dissipation" term. Indeed, T = 
J j ■ (—2WQ)dx, while the expression for the heat dissipation rate had the form ksTQ = J j- (-W)dx. 

Let us notice that T > would tell us that the localization improves, clearly at the expense of 
the energy supply (power injection) from the environment, f < indicates a localization decay and 
corresponds to the energy absorption (power release) by the environment. 

We may typically expect the decrease of the the localization measure T and the continual en- 
ergy/heat absorption by the Smoluchowski diffusion process. This effect can be attributed to the 
active role of the thermal environment which generally leads to a derealization of the initially local- 
ized probability density, unless the invariant measures enter the game. The power release complies 
with the identity TL = since " obviously" the diffusion process proceeds in an open system. The latter 
property should be contrasted with the behavior of so-called finite energy diffusions, |181 1241 13"2] , 
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